Anatomical visualization and measurement system

ABSTRACT

The present invention provides an anatomical visualization and measurement system comprising a first database that comprises a plurality of 2-D slice images generated by scanning a structure. The 2-D slice images are stored in a first data format. A second database is also provided that comprises a 3-D computer model of the scanned structure. The 3-D computer model comprises a first software object that is defined by a 3-D geometry database. Apparatus is provided for selecting a particular 2-D slice image from the first database. Apparatus is also provided for inserting a second software object into the 3-D computer model so as to augment the 3-D computer model. The second software object is also defined by a 3-D geometry database, and includes a planar surface. The second software object is inserted into the 3-D computer model at the position which corresponds to the position of the selected 2-D slice image relative to the scanned structure. Apparatus is also provided for texture mapping the specific 2-D slice image onto the planar surface of the second software object. Display apparatus is provided for displaying an image of the augmented 3-D computer model so as to simultaneously provide a view of the first software object and the specific 2-D slice image texture mapped onto the planar surface of the second software object. Apparatus and method are also provided for determining structural dimensions and volumes using appropriate scanned 2-D slice image information. The apparatus and method are particularly well suited for determining dimensions with respect to structures which follow a tortuous path and/or have a complex branching structure, e.g., vascular structures. Among other things, the present invention permits an appropriate set of scanned 2-D images to be assembled into a 3-D database, information regarding selected structural features to be segmented out of the 3-D database, and measurements to be made based on these structural features. In addition, the present invention permits a set of oblique images to be generated based on these structural features, which oblique images may themselves be used for measurement purposes.

FIELD OF THE INVENTION

This invention relates to medical apparatus in general, and moreparticularly to anatomical visualization and measurement systems.

BACKGROUND OF THE INVENTION

Many medical procedures must be carried out at an interior anatomicalsite which is normally hidden from the view of the physician. In thesesituations, the physician typically uses some sort of scanning device toexamine the patient's anatomy at the interior site prior to, and inpreparation for, conducting the actual medical procedure. Such scanningdevices typically include CT scanners, MRI devices, X-ray machines,ultrasound devices and the like, and essentially serve to provide thephysician with some sort of visualization of the patient's interioranatomical structure prior to commencing the actual medical procedure.The physician can then use this information to plan the medicalprocedure in advance, taking into account patient-specific anatomicalstructure.

In addition to the foregoing, the physician can also use the informationobtained from such preliminary scanning to more precisely identify thelocation of selected structures (e.g., tumors and the like) which maythemselves be located within the interior of internal organs or otherinternal body structures. As a result, the physician can then moreeasily “zero in” on such selected structures during the subsequentmedical procedure.

Furthermore, in many cases, the anatomical structures of interest to thephysician may be quite small and/or difficult to identify with the nakedeye. In these situations, preliminary scanning of the patient's interioranatomical structure using high resolution scanning devices can help thephysician locate various structures of interest during the subsequentmedical procedure.

In addition to the foregoing, scanning devices of the sort describedabove are frequently also used in purely diagnostic procedures. Forexample, scanning devices of the sort described above might be used tolook for stenosis in a blood vessel, or the buildup of plaque in a bloodvessel, or a thinning of the aorta wall, etc.

In general, scanning devices of the sort described above tend togenerate two-dimensional (i.e., “2-D”) images of the patient'sanatomical structure. In many cases, the scanning devices are adapted toprovide a set of 2-D images, with each 2-D image in the set beingrelated to every other 2-D image in the set according to somepre-determined relationship. For example, CT scanners typically generatea series of 2-D images, with each 2-D image corresponding to a specificplane or “slice” taken through the patient's anatomical structure.Furthermore, with many scanning devices, the angle and spacing betweenadjacent image planes or slices is very well defined, e.g., each imageplane or slice may be set parallel to every other image plane or slice,and adjacent image planes or slices may be spaced a pre-determineddistance apart. By way of example, the parallel image planes might beset 1 mm apart.

In a system of the sort just described, the physician can view each 2-Dimage individually and, by viewing a series of 2-D images in propersequence, can mentally generate a three-dimensional (i.e., “3-D”)impression of the patient's interior anatomical structure.

Some scanning devices include, as part of their basic system, associatedcomputer hardware and software for building a 3-D database of thepatient's scanned anatomical structure using a plurality of theaforementioned 2-D images. For example, some CT and MRI scanners includesuch associated computer hardware and software as part of their basicsystem. Alternatively, such associated computer hardware and softwaremay be provided independently of the scanning devices, as a sort of“add-on” to the system; in this case, the data from the scanned 2-Dimages is fed from the scanning device to the associated computerhardware and software in a separate step. In either case, a trainedoperator using such apparatus can create a set of scanned 2-D images,assemble the data from these scanned 2-D images into a 3-D database ofthe scanned anatomical structure, and then generate various additionalimages of the scanned anatomical structure using the 3-D database. Thisfeature has been found to be a very powerful tool, since it essentiallypermits a physician to view the patient's scanned anatomical structurefrom a wide variety of different viewing positions. As a result, thephysician's understanding of the patient's scanned anatomical structureis generally greatly enhanced.

In addition, scanning systems of the sort described above often includehardware and/or software tools to allow measurements to be made of thepatient's scanned anatomical structure. By way of example, many of thesesystems let a physician overlay lines on an image of the patient'sanatomical structure, and then calculate the length of these lines so asto indicate the size of the structure being viewed.

While the 2-D slice images generated by the aforementioned scanningdevices, and/or the 3-D database images generated by the aforementionedassociated computer hardware and software, are generally of greatbenefit to physicians, certain significant limitations still exist.

For one thing, with current systems, each scanned 2-D slice image isdisplayed as a separate and distinct image, and each image generatedfrom the 3-D database is displayed as a separate and distinct image.Unfortunately, physicians can sometimes have difficulty correlating whatthey see on one image with what they see on another image. By way ofexample but not limitation, physicians can sometimes have difficultycorrelating what they see on a particular scanned 2-D slice image withwhat they see on a particular image generated from the 3-D database.

For another thing, in many situations a physician may be viewing imagesof a patient's scanned anatomical structure in preparation forconducting a subsequent medical procedure in which a prosthetic devicemust be fitted in the patient. In these situations it can be relativelydifficult and/or time-consuming for the physician to accurately measureand record all of the anatomical dimensions needed for proper sizing ofthe prosthetic device to the patient. By way of example, in certainsituations a patient may develop an abdominal aortic aneurysm (“AAA”) inthe vicinity of the aorta's iliac branching, and repair or replacementof the affected vascular structure with a prosthetic device may beindicated. In this case it is extremely important for the physician todetermine, prior to commencing the procedure, accurate length andcross-sectional dimensions for each affected portion of blood vessel soas to ensure proper sizing of the appropriate prosthetic device to thepatient. Unfortunately, it can be difficult and/or impossible to makeaccurate anatomical measurements with existing visualization systems.This has proven to be particularly true when dealing with anatomicalstructures which extend along a tortuous path and/or which have acomplex and varied branching structure, e.g., blood vessels.

Furthermore, in many cases it may be desirable to provide a physicianwith a particular oblique view of a specified portion of a patient'sanatomical structure. For example, it may be desirable to provide aphysician with a view taken perpendicular to the length of a bloodvessel, with that view being taken at a very specific location alongthat blood vessel. Such a view might be desired for comprehensionaland/or measurement purposes. Unfortunately, it can be difficult and/orimpossible to accurately generate such a view using existingvisualization systems.

In addition to the foregoing, in many situations a physician may beinterested in accurately calculating a volume associated with a specificpart of a patient's anatomy. By way of example but not limitation, aphysician might wish to track the volume of a thrombus in an aorta overtime, or the size of a tumor during chemotherapy, etc. Unfortunately, itcan be difficult and/or impossible to accurately make such a calculationusing existing visualization systems.

OBJECTS OF THE INVENTION

Accordingly, one object of the present invention is to provide animproved anatomical visualization and measurement system for visualizingand measuring anatomical structures.

Another object of the present invention is to provide an improvedanatomical visualization and measurement system wherein a scanned 2-Dslice image can be appropriately combined with an image generated from a3-D database so as to create a single composite image.

Another object of the present invention is to provide an improvedanatomical visualization and measurement system wherein a marker can beplaced onto a 2-D slice image displayed on a screen, and this markerwill be automatically incorporated, as appropriate, into a 3-D computermodel maintained by the system, as well as into any other 2-D sliceimage data maintained by the system.

Still another object of the present invention is to provide an improvedanatomical visualization and measurement system wherein a margin ofpre-determined size can be associated with a marker of the sortdescribed above, and further wherein the margin will be automaticallyincorporated into the 3-D computer model, and into any other 2-D sliceimage data, in association with that marker.

Yet another object of the present invention is to provide an improvedanatomical visualization and measurement system wherein the periphery ofobjects contained in a 3-D computer model maintained by the system canbe automatically identified in any 2-D slice image data maintained bythe system, and further wherein the periphery of such objects can behighlighted as appropriate in 2-D slice images displayed by the system.

Another object of the present invention is to provide an improvedanatomical visualization and measurement system wherein patient-specificanatomical dimensions such as length and/or cross-sectional dimensionscan be quickly, easily and accurately determined.

Still another object of the present invention is to provide an improvedanatomical visualization and measurement system which is particularlywell adapted to determine patient-specific anatomical dimensions forstructures which have a tortuous and/or branching configuration, e.g.,blood vessels.

And another object of the present invention is to provide an improvedanatomical visualization and measurement system wherein an appropriateset of scanned 2-D images can be assembled into a 3-D database,information regarding patient-specific anatomical structures can besegmented from the information contained in this 3-D database, and thissegmented information can then be used to determine anatomical featuressuch as a centerline for the anatomical structure which has beensegmented.

Still another object of the present invention is to provide an improvedanatomical visualization and measurement system which is able to easilyand accurately present a physician with a particular oblique view of aspecified portion of a patient's anatomical structure, e.g., a viewtaken perpendicular to the length of a blood vessel, with that viewbeing taken at a very specific location along that blood vessel.

Another object of the present invention is to provide an improvedanatomical visualization and measurement system wherein patient-specificanatomical volumes can be quickly, easily and accurately determined.

And another object of the present invention is to provide an improvedanatomical visualization and measurement system wherein an appropriateset of scanned 2-D images can be assembled into a 3-D database,information regarding patient-specific anatomical structures can besegmented from the information contained in this 3-D database, and thissegmented information can then be used to calculate desiredpatient-specific anatomical volumes.

Another object of the present invention is to provide an improved methodfor visualizing and measuring anatomical structures.

And another object of the present invention is to provide an improvedmethod wherein patient-specific anatomical dimensions such as lengthand/or cross-sectional dimensions can be quickly, easily and accuratelydetermined.

Still another object of the present invention is to provide an improvedmethod wherein an appropriate set of scanned 2-D images can be assembledinto a 3-D database, information regarding patient-specific anatomicalstructures can be segmented from the information contained in this 3-Ddatabase, and this segmented information can then be used to determineanatomical features such as a centerline for the anatomical structurewhich has been segmented.

And another object of the present invention is to provide a method foreasily and accurately presenting a physician with a particular obliqueview of a specified portion of a patient's anatomical structure, e.g., aview taken perpendicular to the length of a blood vessel, with that viewbeing taken at a very specific location along that blood vessel.

Yet another object of the present invention is to provide an improvedmethod for quickly, easily and accurately determining patient-specificanatomical volumes.

SUMMARY Of THE INVENTION

These and other objects are addressed by the present invention, whichcomprises an anatomical visualization and measurement system comprisinga first database which comprises a plurality of 2-D slice imagesgenerated by scanning an anatomical structure. These 2-D slice imagesare stored in a first data format. A second database is also providedwhich comprises a 3-D computer model of the scanned anatomicalstructure. This 3-D computer model comprises a first software objectwhich is representative of the scanned anatomical structure and which isdefined by a 3-D geometry database.

In one embodiment of the present invention, means are provided forselecting a particular 2-D slice image from the first database. Meansare also provided for inserting a second software object into the 3-Dcomputer model so as to augment the 3-D computer model. The secondsoftware object is also defined by a 3-D geometry database, and includesa planar surface. In this embodiment of the invention, the secondsoftware object is inserted into the 3-D computer model at the positionwhich corresponds to the position of the selected 2-D slice imagerelative to the scanned anatomical structure. Means for texture mappingthe specific 2-D slice image onto the planar surface of the secondsoftware object are also provided. Means are also provided fordisplaying an image of the augmented 3-D computer model so as tosimultaneously provide a view of both the first software object and thespecific 2-D slice image which has been texture mapped onto the planarsurface of the second software object.

In another embodiment of the invention, the system comprises a firstdatabase which comprises a plurality of 2-D slice images generated byscanning an anatomical structure. These 2-D slice images are stored in afirst data format. A second database is also provided which comprises a3-D computer model of the scanned anatomical structure. This 3-Dcomputer model comprises a first software object which is representativeof the scanned anatomical structure and which is defined by a 3-Dgeometry database. In this second embodiment of the invention, means arealso provided for inserting a second software object into the 3-Dcomputer model so as to augment the 3-D computer model. The secondsoftware object is also defined by a 3-D geometry database, and includesa planar surface. Furthermore, means are also provided for determiningthe specific 2-D slice image which corresponds to the position of theplanar surface of the second software object which has been insertedinto the augmented 3-D computer model. In this embodiment of theinvention, means are also provided for texture mapping the specific 2-Dslice image corresponding to the position of that planar surface ontothe planar surface of the second software object. In this embodiment ofthe invention, display means are also provided for displaying an imageof the augmented 3-D computer model to a physician so as tosimultaneously provide a view of the first software object and thespecific 2-D slice image which has been texture mapped onto the planarsurface of the second software object.

In each of the foregoing embodiments of the present invention, the 3-Dgeometry database may comprise a surface model.

Likewise, the system may further comprise means for inserting a markerinto the first database, whereby the marker will be automaticallyincorporated into the second database, and further wherein the markerwill be automatically displayed where appropriate in any image displayedby the system.

Also, the system may further comprise a margin of pre-determined sizeassociated with the aforementioned marker.

Additionally, the system may further comprise means for automaticallyidentifying the periphery of any objects contained in the seconddatabase and for identifying the corresponding data points in the firstdatabase, whereby the periphery of such objects can be highlighted asappropriate in any image displayed by the system.

Often, the scanned structure will comprise an interior anatomicalstructure.

In yet another form of the present invention, the visualization andmeasurement system may incorporate means for determiningpatient-specific anatomical dimensions, such as length and/orcross-sectional dimensions, using appropriate scanned 2-D image data.More particularly, the visualization and measurement system may includemeans for assembling an appropriate set of scanned 2-D images into a 3-Ddatabase, means for segmenting information regarding patient-specificanatomical structures from the information contained in the 3-Ddatabase, means for determining from this segmented informationanatomical features such as a centerline for the anatomical structurewhich has been segmented, means for specifying a measurement to be madebased on the determined anatomical feature, and means for calculatingthe measurements so specified.

In a more particular form of the present invention, the visualizationand measurement system is particularly well adapted to determinepatient-specific anatomical dimensions for structures which have atortuous and/or branching configuration, e.g., blood vessels. In thisform of the invention, the visualization and measurement system isadapted to facilitate (1) assembling an appropriate set of scanned 2-Dimages into a 3-D database; (2) segmenting the volumetric data containedin the 3-D database into a set of 3-D locations corresponding to thespecific anatomical structure to be measured; (3) specifying, for eachbranching structure contained within the specific anatomical structureof interest, a branch line in the volumetric data set that uniquelyindicates that branch structure, with the branch line being specified byselecting appropriate start and end locations on two of the set ofscanned 2-D images; (4) calculating, for each branching structurecontained within the specific anatomical structure of interest, acentroid path in the volumetric data set for that branching structure,with the centroid path being determined by calculating, for each scanned2-D image corresponding to the branch line, the centroid for the branchstructure contained in that particular scanned 2-D image; (5) applying acurve-fitting algorithm to the centroid paths determined above so as tosupply data for any portions of the anatomical structure which may liebetween the aforementioned branch lines, and for “smoothing out” anynoise that may occur in the system; and (6) applying known techniques tothe resulting space curves so as to determine the desired anatomicaldimensions.

In still another form of the present invention, the visualization andmeasurement system may incorporate means for easily and accuratelypresenting a physician with a particular oblique view of a specifiedportion of a patient's anatomical structure, e.g., a view takenperpendicular to a blood vessel, at a very specific location along thatblood vessel.

In another form of the present invention, the visualization andmeasurement system may incorporate means for more accurately measuringthe dimensions of an anatomical structure by utilizing one or moreoblique views taken along the length of that anatomical structure.

In yet another form of the present invention, the visualization andmeasurement system may incorporate means for determiningpatient-specific anatomical volumes using appropriate scanned 2-D imagedata. More particularly, the visualization and measurement system mayinclude means for assembling an appropriate set of scanned 2-D imagesinto a 3-D database, means for segmenting information regardingpatient-specific anatomical structures from the information contained inthe 3-D database, means for determining from this segmented informationanatomical volumes from the anatomical structure which has beensegmented, means for specifying a structure of interest, and means forcalculating the volume of the specified structure.

The present invention also comprises an improved method for visualizingand measuring anatomical structures.

The present invention also comprises a method for calculatingpatient-specific anatomical dimensions using appropriate scanned 2-Dimage data. In one form of the present invention, the method comprisesthe steps of (1) assembling an appropriate set of scanned 2-D imagesinto a 3-D database; (2) segmenting information regardingpatient-specific anatomical structures from the information contained inthe 3-D database, (3) determining for this segmented informationanatomical features such as a centerline for the anatomical structurewhich has been segmented; (4) specifying a measurement to be made basedon the determined anatomical feature; and (5) calculating themeasurement so specified.

The present invention also comprises a method for easily and accuratelypresenting a physician with a particular oblique view of a specifiedportion of a patient's anatomical structure, e.g., a view takenperpendicular to a blood vessel, at a very specific location along thatblood vessel.

The present invention also comprises a method for calculatingpatient-specific anatomical volumes using appropriate scanned 2-D imagedata. In one form of the present invention, the method comprises thesteps of (1) assembling an appropriate set of scanned 2-D images into a3-D database; (2) segmenting information regarding patient-specificanatomical structures from the information contained in the 3-Ddatabase, (3) determining from this segmented information volumes forthe anatomical structure which has been segmented, (4) specifying astructure of interest, and (5) calculating the volume of the specifiedstructure.

BRIEF DESCRIPTION OF THE DRAWINGS

These and other objects and features of the present invention will bemore fully disclosed or rendered obvious by the following detaileddescription of the preferred embodiments of the invention, which is tobe considered together with the accompanying drawings wherein likenumbers refer to like parts, and further wherein:

FIG. 1 is a schematic view showing a scanning device for generating aset of 2-D images of the anatomy of a patient;

FIG. 2 is a 2-D slice image corresponding to an axial slice takenthrough the abdomen of an individual;

FIG. 3 shows a series of data frames corresponding to 2-D slice imagesarranged in a parallel array;

FIG. 4 is a schematic view showing the scanning data contained within anexemplary data frame;

FIG. 5 shows scanning data stored in a first storage device or mediumbeing retrieved, processed and then stored again in a second datastorage device or medium;

FIG. 6 is a schematic view of a system for retrieving and viewingscanning data;

FIG. 7 is a schematic view of a unit cube for use in defining polygonalsurface models;

FIG. 8 illustrates the data file format of the polygonal surface modelfor the simple unit cube shown in FIG. 7;

FIGS. 9A-9F illustrate a variety of menu choices which may be utilizedin connection with the present invention;

FIG. 10 illustrates an image drawn to a window using the data containedin the 3-D computer model associated with the present invention;

FIG. 11 illustrates a 2-D slice image drawn to a window in accordancewith the present invention;

FIG. 12 illustrates a composite image formed from information containedin both the 3-D computer model and the 2-D slice image data structure;

FIG. 13 is a schematic illustration showing the relationship betweenaxial slices, sagittal slices and coronal slices;

FIG. 14 illustrates three different images being displayed on a computerscreen at the same time, with a marker being incorporated into each ofthe images;

FIG. 15 illustrates a marker shown in an image generated from the 3-Dcomputer model, with the marker being surrounded by a margin ofpre-determined size;

FIG. 16 illustrates a 2-D slice image, wherein the periphery of anobject has been automatically highlighted by the system;

FIG. 17 is a schematic illustration showing various anatomicalstructures on a 2-D slice image, where that 2-D slice image has beentaken axially through the abdomen of a patient, at a location above theaortic/iliac branching;

FIG. 18 is a schematic illustration showing various anatomicalstructures on another 2-D slice image, where that 2-D slice image hasbeen taken through the abdomen of the same patient, at a location belowthe aortic/iliac branching;

FIGS. 17A and 18A are schematic illustrations like those of FIGS. 17 and18, respectively, except that segmentation has been performed in the 3-Ddatabase so as to highlight the patient's vascular structure;

FIG. 19 is a schematic illustration showing that same patient's vascularstructure in the region about the aortic/iliac branching, with branchlines having been specified for the patient's aorta and two iliacbranches;

FIG. 20 is a schematic illustration showing how the centroid iscalculated for the branch structure contained in a particular scanned2-D image;

FIG. 21 is a schematic illustration showing the tortuous centroid pathcalculated for each of the respective branch lines shown in FIG. 19;

FIG. 22 is a schematic illustration showing the space curve determinedby applying a curve-fitting algorithm to two of the centroid paths shownin FIG. 21, whereby the structure between the branch lines is filled outand the centroid data “smoothed” through a “best fit” interpolationtechnique;

FIG. 23 is a flow chart illustrating how patient-specific anatomicaldimensions can be determined from scanned 2-D image data in accordancewith the present invention;

FIG. 24 is a schematic view showing an oblique slice polygon disposedperpendicular to the centerline of a blood vessel;

FIG. 25 is a cumulative sum table for calculating lengths along ananatomical structure;

FIG. 26 illustrates a centerline length calculation dialogue box drawnto a window in a display;

FIG. 27 illustrates a 3-D graphical icon which has been inserted intothe 3-D model and which is visible on the display so as to show theportion of the centerline which has been specified by the physician fora length calculation;

FIG. 28 is a cumulative sum table for calculating volumes with respectto an anatomical structure;

FIG. 29 illustrates a volume calculation dialogue box drawn to a windowin a display; and

FIG. 30 illustrates a 3-D graphical icon which has been inserted intothe 3-D model and which is visible on the display so as to show thevolume which has been specified by the physician using the volumecalculation dialogue box.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT Basic System

Looking first at FIG. 1, a scanning device 5 is shown as it scans theinterior anatomical structure of a patient 10, as that patient 10 lieson a scanning platform 15.

Scanning device 5 is of the sort adapted to generate scanning datacorresponding to a series of 2-D images, where each 2-D imagecorresponds to a specific viewing plane or “slice” taken through thepatient's body. Furthermore, scanning device 5 is adapted so that theangle and spacing between adjacent image planes or slices can be verywell defined, e.g., each image plane or slice may be set parallel toevery other image plane or slice, and adjacent image planes or slicesmay be spaced a pre-determined distance apart. By way of example, theparallel image planes might be set 1 mm apart.

The scanning data obtained by scanning device 5 can be displayed as a2-D slice image on a display 20, and/or it can be stored in its 2-Dslice image data form in a first section 23 of a data storage device ormedium 25. Furthermore, additional information associated with thescanning data (e.g., patient name, age, etc.) can be stored in a secondsection 27 of data storage device or medium 25.

By way of example, scanning device 5 might comprise a CT scanner of thesort manufactured by GE Medical Systems of Milwaukee, Wis.

By way of further example, a 2-D slice image of the sort generated byscanning device 5 and displayed on display 20 might comprise the 2-Dslice image shown in FIG. 2. In the particular example shown in FIG. 2,the 2-D slice image shown corresponds to an axial slice taken through anindividual's abdomen and showing, among other things, that individual'sliver.

Scanning device 5 may format its scanning data in any one of a number ofdifferent data structures. By way of example, scanning device 5 mightformat its scanning data in the particular data format used by a CTscanner of the sort manufactured by GE Medical Systems of Milwaukee,Wis. More specifically, with such a scanning device, the scanning datais generally held as a series of data “frames”, where each data framecorresponds to a particular 2-D slice image taken through the patient'sbody. Furthermore, within each data frame, the scanning data isgenerally organized so as to represent the scanned anatomical structureat a particular location within that 2-D slice image. Such a datastructure is fairly common for scanning devices of the sort associatedwith the present invention. However, it should be appreciated that thepresent invention is not dependent on the particular data formatutilized by scanning device 5. For the purposes of the presentinvention, the scanning data provided by scanning device 5 can beformatted in almost any desired data structure, so long as that datastructure is well defined, whereby the scanning data can be retrievedand utilized as will hereinafter be disclosed in further detail.

For purposes of illustrating the present invention, it can be convenientto think of the scanning data generated by scanning device 5 as beingorganized in the data structures schematically illustrated in FIGS. 3and 4.

More particularly, in FIG. 3, a series of data frames 30A, 30B, 30C,etc. are shown arranged in a parallel array. Each of these data frames30A, 30B, 30C, etc. corresponds to a particular 2-D slice image takenthrough the patient's body by scanning device 5, where the 2-D sliceimages are taken parallel to one another. In addition, adjacent imageplanes or slices are spaced apart by a constant, pre-determineddistance, e.g., 1 mm. It will be appreciated that data frames 30A, 30B,30C, etc. collectively form a volumetric data set which isrepresentative of the patient's scanned anatomical structure.

Furthermore, in FIG. 4, the scanning data contained within an exemplarydata frame 30A is shown represented in an X-Y coordinate scheme so as toquickly and easily identify the scanned anatomical structure disposed ata particular location within that 2-D slice image. Typically, thescanning data relating to a particular X-Y coordinate represents animage intensity value. This image intensity value generally reflectssome attribute of the specific anatomical structure being scanned, e.g.,the tissue density.

As noted above, the scanning data generated by scanning device 5 isstored in its 2-D slice image data form in first section 23 of datastorage device or medium 25, with the scanning data being stored in aparticular data format as determined by the manufacturer of scanningdevice 5.

In accordance with the present invention, and looking now at FIG. 5, thescanning data stored in first section 23 of data storage device ormedium 25 is retrieved, processed and then stored again in a datastorage device or medium 30.

More particularly, the scanning data stored in first section 23 of datastorage device or medium 25 is retrieved and processed so as to convertthe scanning data generated by scanning device 5 from its 2-D sliceimage data form into a 3-D computer model of the patient's anatomicalstructure. This 3-D computer model is then stored in a first section 35of data storage device or medium 30.

In addition, the scanning data stored in first section 23 of datastorage device or medium 25 is retrieved and processed as necessary soas to convert the scanning data into a preferred data format for the 2-Dslice image data. The 2-D slice image data is then stored in thispreferred data format in second section 40 of data storage device ormedium 30.

Furthermore, the additional information associated with the scanningdata (e.g., patient name, age, etc.) which was previously stored insecond section 27 of data storage device or medium 25 can be stored in athird section 42 of data storage device or medium 30.

In accordance with the present invention, once the 3-D computer modelhas been stored in first section 35 of data storage device or medium 30,and the 2-D slice image data has been stored in a preferred data formatin second section 40 of data storage device or medium 30, a physiciancan then use an appropriately programmed computer to access the 3-Dcomputer model stored in first section 35 of data storage device ormedium 30, and/or the 2-D slice image data stored in second section 40of data storage device or medium 30, to generate desiredpatient-specific images.

More particularly, and looking now at FIG. 6, once the 3-D computermodel has been stored in first section 35 of data storage device ormedium 30, and the 2-D slice image data has been stored in a preferreddata format in second section 40 of data storage device or medium 30, aphysician can use an appropriately programmed computer 50, operated byinput devices 55, to access the 3-D computer model stored in firstsection 35 of data storage device or medium 30, and/or the 2-D sliceimage data stored in second section 40 of data storage device or medium30, so as to generate the desired patient-specific images and displaythose images on a display 60.

To this end, it will be appreciated that the specific data structureused to store the 3-D computer model in first section 35 of data storagedevice or medium 30, and the specific data structure used to store the2-D slice image data in second section 40 of data storage device ormedium 30, will depend on the specific nature of computer 50 and on theparticular operating system and application software being run oncomputer 50.

In general, however, the 3-D computer model contained in first section35 of data storage device or medium 30 is preferably structured as acollection of software objects, with each software object being definedby a polygonal surface model of the sort well known in the art. By wayof example, a scanned anatomical structure such as a human liver mightbe modeled as three distinct software objects, with the outer surface ofthe general mass of the liver being one software object, the outersurface of the vascular structure of the liver being a second softwareobject, and the outer surface of a tumor located in the liver being athird software object. By way of further example, FIGS. 7 and 8illustrate a typical manner of defining a software object by a polygonalsurface model. In particular, FIG. 7 illustrates the vertices of a unitcube set in an X-Y-Z coordinate system, and FIG. 8 illustrates the datafile format of the polygonal surface model for this simple unit cube. Asis well known in the art, more complex shapes such as human anatomicalstructure can be expressed in corresponding terms.

Furthermore, the 3-D computer model contained in first section 35 ofdata storage device or medium 30 is created by analyzing the 2-D sliceimage data stored in first section 23 of data storage device or medium25 using techniques well known in the art. For example, the 2-D sliceimage data stored in first section 23 of data storage device or medium25 might be processed using the well known “Marching Cubes” algorithm,which is a so-called “brute force” surface construction algorithm thatextracts isodensity surfaces from a volumetric data set, producing fromone to five triangles within voxels that contain the surface.Alternatively, the 2-D slice image data stored in first section 23 ofdata storage device or medium 25 might be processed into the 3-Dcomputer model stored in first section 35 of data storage device ormedium 30 by some other appropriate modeling algorithm so as to yieldthe desired 3-D computer model which is stored in first section 35 ofdata storage device or medium 30.

As noted above, the specific data structure used to store the 2-D sliceimage data in second section 40 of data storage device or medium 30 willalso depend on the specific nature of computer 50 and on the particularoperating system and application software being run on computer 50.

In general, however, the 2-D slice image data contained in secondsection 40 of data storage device or medium 30 is preferably structuredas a series of data “frames”, where each data frame corresponds to aparticular 2-D slice image taken through the patient's body, and wherethe scanning data within each data frame is organized so as to representthe scanned anatomical structure at a particular location within that2-D slice image.

In the present invention, it is preferred that computer 50 comprise aPower PC-based, Macintosh operating system (“Mac OS”) type of computer,e.g. a Power PC Macintosh 8100/80 of the sort manufactured by AppleComputer, Inc. of Cupertino, Calif. In addition, it is preferred thatcomputer 50 be running Macintosh operating system software, e.g. Mac OSVer. 7.5.1, such that computer 50 can readily access a 3-D computermodel formatted in Apple's well-known QuickDraw 3D data format anddisplay images generated from that 3D computer model, and such thatcomputer 50 can readily access and display 2-D images formatted inApple's well-known QuickTime image data format. Input devices 55preferably comprise the usual computer input devices associated with aPower PC-based, Macintosh operating system computer, e.g., input devices55 preferably comprise a keyboard, a mouse, etc.

In view of the foregoing, in the present invention it is also preferredthat the 3-D computer model contained in first section 35 of datastorage device or medium 30 be formatted in Apple's QuickDraw 3D dataformat, whereby the Mac OS computer 50 can quickly and easily access the3-D computer model contained in first section 35 of data storage deviceor medium 30 and display images generated from that 3-D computer modelon display 60.

In view of the foregoing, in the present invention it is also preferredthat the 2-D slice image data contained in second section 40 of datastorage device or medium 30 be formatted in Apple's QuickTime image dataformat. In this way computer 50 can quickly and easily display thescanned 2-D slice images obtained by scanning device 5. It will beappreciated that, to the extent that scanning device 5 happens to formatits scanning data in the preferred QuickTime image data format, noreformatting of the 2-D slice image data will be necessary prior tostoring the 2-D slice image data in second section 40 of data storagedevice or medium 30. However, to the extent that scanning device 5happens to format its scanning data in a different data structure,reformatting of the 2-D slice image data will be necessary so as to putit into the preferred QuickTime image data format. Such image datareformatting is of the sort well known in the art.

As a result of the foregoing, it will be seen that a physician operatingcomputer 50 through input devices 55 can generate a desired image fromthe 3-D computer model contained within first section 35 of data storagedevice or medium 30. In particular, the physician can use input devices55 to (1) open a window on display 60, (2) instruct the computer as tothe desired angle of view, (3) generate the corresponding image of thescanned anatomical structure from the desired angle of view, using the3-D computer model contained within first section 35 of data storagedevice or medium 30, and (4) display that image in the open window ondisplay 60.

In addition, a physician operating computer 50 through input devices 55can display a desired 2-D slice image from the 2-D slice image datacontained within second section 40 of data storage device or medium 30.In particular, the physician can use input devices 55 to (1) open awindow on display 60, (2) select a particular 2-D slice image containedwithin second section 40 of data storage device or medium 30, and (3)display that slice image in the open window on display 60.

More particularly, and looking now at FIGS. 9A-9F, computer 50 ispreferably programmed so as to provide a variety of pre-determined menuchoices which may be selected by the physician operating computer 50 viainput devices 55.

Thus, for example, if the physician wishes to produce a desired imagefrom the 3-D computer model contained within first section 35 of datastorage device or medium 30, the physician uses input devices 55 toinvoke the command to display the 3-D computer model; the software thencreates a window to display the image, it renders an image from the 3-Dcomputer model contained within first section 35 of data storage deviceor medium 30, and then displays that image in the open window on display60. By way of example, FIG. 10 illustrates an image drawn to a windowusing the data contained in the 3-D computer model stored in firstsection 35 of data storage device or medium 30. The physician can useinput devices 55 to instruct the image rendering software as to thespecific angle of view desired. In particular, computer 50 is preferablyprogrammed so that the physician can depress a mouse key and then dragon the object so as to rotate the object into the desired angle of view.Additionally, computer 50 is preferably programmed so that the physiciancan also use the keyboard and mouse to move the view closer in orfurther out, or to translate the object side to side or up and downrelative to the image plane. Programming to effect such computeroperation is of the sort well known in the art.

In a similar manner, the physician can use menu choices such as thoseshown in FIGS. 9A-9F to open a window on the display 60 and then todisplay in that window a desired 2-D slice image from second section 40of data storage device or medium 30. Computer 50 is programmed so thatthe physician can select between different slice images by means ofinput devices 55. By way of example, FIG. 11 illustrates a 2-D sliceimage drawn to a window by the operating system using the data containedin second section 40 of data storage device or medium 30. In this case,computer 50 is programmed so that, by dragging icon 70 back and forthalong slider 75, the physician can “leaf” back and forth through thecollection of axial slices, i.e., in the example of FIG. 11, in whichaxial slice #21 is displayed, dragging icon 70 to the left might causeaxial slice #20 to be displayed, and dragging icon 70 to the right mightcause axial slice #22 to be displayed. Additionally, computer 50 ispreferably programmed so that the physician can also step the image fromthe current slice number to a previous or following slice number byusing menu commands or by clicking the mouse cursor on the single stepicons 76 set at the right side of slider 75. Computer 50 is preferablyalso programmed so that menu commands are provided to change the slicewindow display directly to the first or last slice image in the 2-Dslice image set, or to change the slice window display to auser-specified slice number. Programming to effect such computeroperation is of the sort well known in the art.

As a consequence of using the aforementioned hardware and softwarearchitecture (i.e., the Macintosh computer, the Mac OS, the AppleQuickDraw 3D data format and software, and the Apple QuickTime imagedata format and software, or some equivalent hardware and software), itis possible to insert an additional software object into the 3-Dcomputer model contained within first section 35 of data storage deviceor medium 30. In particular, it is possible to insert an additionalsoftware object having a “blank” planar surface into the 3-D computermodel. Furthermore, using the computer's image rendering software, it ispossible to texture map a 2-D slice image from second section 40 of datastorage device or medium 30 onto the blank planar surface of theinserted software object. Most significantly, since the 3-D computermodel is created out of the same scanning data as the 2-D slice images,it is possible to determine the specific 2-D slice image whichcorresponds to a given position of the blank planar surface within the3-D computer model. Accordingly, with the present invention, when animage is generated from the 3-D computer model, both 3-D model structureand 2-D slice image structure can be simultaneously displayed in properregistration with one another, thereby providing a single compositeimage of the two separate images. See, for example, FIG. 12, which showssuch a composite image. Again, computer 50 is programmed so that thephysician can use input devices 55 to instruct the operating system'simage rendering software as to where the aforementioned “additional”software object is to be inserted into the model and as to theparticular angle of view desired. Programming to effect such computeroperation is of the sort well known in the art.

Additionally, computer 50 is also programmed so that (1) the physiciancan use input devices 55 to select a particular 2-D slice image from thesecond section 40 of data storage device or medium 30, and (2) thecomputer will then automatically insert the aforementioned additionalsoftware object into the 3-D computer model so that the object's “blank”planar surface is located at the position which corresponds to theposition of the selected 2-D slice image relative to the scannedanatomical structure. Again, programming to effect such computeroperation is of the sort well known in the art.

In the foregoing description of the present invention, the 2-D sliceimage data generated by scanning device 5 has generally been discussedin the context of the standard “axial” slice images normally generatedby scanning devices of the type associated with this invention. However,it is to be appreciated that the present invention is also adapted toutilize sagittal and/or coronal 2-D slice images. Furthermore, it isalso to be appreciated that the present invention is adapted to utilizeoblique slice images of the type hereinafter described.

More particularly, and looking next at FIG. 13, the relative orientationof axial, sagittal and coronal slice images are shown in the context ofa schematic view of a human body 80. Scanning device 5 will normallygenerate axial slice image data when scanning a patent. In addition, inmany cases scanning device 5 will also assemble the axial slice datainto a 3-D database (i.e., a volumetric data set) of the scannedanatomical structure, and then use this 3-D database to generate acorresponding set-of sagittal and/or coronal 2-D slice images. In theevent that scanning device 5 does not have the capability of generatingthe aforementioned sagittal and/or coronal 2-D slice images, suchsagittal and/or coronal 2-D slice images may be generated from a set ofthe axial 2-D images in a subsequent operation, using computer hardwareand software of the sort well known in the art. Alternatively, ifdesired, computer 50 may be programmed to render such sagittal and/orcoronal 2-D slices “on the fly” from the 2-D slice image data containedin second section 40 of data storage device or medium 30.

In connection with the present invention, the sagittal and coronal 2-Dslice image data may be stored with the axial slice image data in secondsection 40 of data storage device or medium 30. Preferably thesesagittal and coronal slice images are stored in exactly the same dataformat as the 2-D axial slice images, whereby they may be easilyaccessed by computer 50 and displayed on display 60 in the same manneras has been previously discussed in connection with axial 2-D sliceimages. As a result, axial, sagittal and coronal 2-D slice images can bedisplayed on display 60, either individually or simultaneously inseparate windows, in the manner shown in FIG. 14. Furthermore, whengenerating a composite image of the sort shown in FIG. 12 (i.e., animage generated from both the 3-D computer model contained in firstsection 35 of data storage device or medium 30 and a 2-D slice imagecontained in second section 40 of data storage device or medium 30), thecomposite image can be created using axial, sagittal or coronal 2-Dslice images, as preferred.

It is also to be appreciated that the system of the present invention isalso configured so as to generate and utilize oblique 2-D slice imagedata in place of the axial, sagittal and coronal slice image datadescribed above. More particularly, computer 50 is programmed so that aphysician can use input devices 55 to specify the location of theoblique 2-D slice image desired, and then computer 50 generates that 2-Dslice image from the volumetric data set present in second section 40 ofdata storage device or medium 30 (i.e., from the collection of 2-D sliceimages contained in second section 40 of data storage device or medium30).

It should be appreciated that data storage device or medium 30 cancomprise conventional storage media (e.g., a hard disk, a CD ROM, a tapecartridge, etc.), which can be located either on-site or at a remotelocation linked via appropriate data transfer means.

Markers And Margins

In a further aspect of the present invention, computer 50 is programmedso that a physician can display a specific 2-D slice image in a windowopened on display 60, place a marker into that specific 2-D slice imageusing a mouse or other input device 55, and then have that markerautomatically incorporated into both (i) the 3-D computer modelcontained in first section 35 of data storage device or medium 30, and(ii) any appropriate 2-D slice image data contained in second section 40of data storage device or medium 30. As a result, when images arethereafter generated from the 3-D computer model contained in firstsection 35 of data storage device or medium 30, and/or from the 2-Dslice image data contained in second section 40 of data storage deviceor medium 30, these subsequent images will automatically display themarker where appropriate. See, for example, FIG. 14, which shows onesuch marker 85 displayed in its appropriate location in each of thethree displayed 2-D slice images, i.e., in axial slice image 90,sagittal slice image 95, and coronal slice image 100. It is to beappreciated that it is also possible for marker 85 to be displayed whereappropriate in an image generated from the 3-D computer model containedin first section 35 of data storage device or medium 30; see, forexample, FIG. 15, which shows such a marker 85 being displayed in theimage.

In yet another aspect of the present invention, computer 50 isprogrammed so that a physician can generate a “margin” of somepredetermined size around such a marker. Thus, for example, in FIG. 15,a margin 105 has been placed around marker 85. In this respect it is tobe appreciated that margin 105 will appear as a 3-dimensional sphericalshape around marker 85, just as marker 85 appears as a 3-dimensionalshape, since the view of FIG. 15 is generated from the 3-D computermodel contained in first section 35 of data storage device or medium 30.Alternatively, where marker 85 and margin 105 are displayed in thecontext of 2-D slice images, the marker and margin will appear as simplecircles. Margin 105 can be used by a physician to determine certainspatial relationships in the context of the anatomical structure beingdisplayed on the computer.

Peripheral Highlighting

It is also to be appreciated that, inasmuch as the 3-D computer modelcontained in first section 35 of data storage device or medium 30constitutes a plurality of software objects defined by polygonal surfacemodels, it is possible to identify the periphery of any such objects inany corresponding 2-D slice image data contained in second section 40 ofdata storage device or medium 30. As a result, it is possible tohighlight the periphery of any such object in any 2-D slice imagesdisplayed on display 60. Thus, in another aspect of the invention,computer 50 is programmed so that a physician can select one or moreanatomical structures using an input device 55, and the computer willthen highlight the periphery of that structure in any corresponding 2-Dslice images displayed on display 60. See, for example, FIG. 16, where aboundary 110 is shown outlining the periphery of an object 115 displayedin a 2-D slice image.

Other Modifications Of The Basic System

Furthermore, while in the foregoing description the present inventionhas been described in the context of an anatomical visualization systembeing used by a physician, it is also to be appreciated that the systemcould be used in conjunction with inanimate objects being viewed by anon-physician, e.g., the system could be used to visualize substantiallyany object for which a 3-D computer model and a collection of 2-D sliceimage data can be assembled.

It is also anticipated that one might replace the polygonal surfacemodel discussed above with some other type of surface model. Thus, asused herein, the term “surface model” is intended to include polygonalsurface models, parametric surface models such as B-spline surfacemodels, quadralateral meshes, etc.

Centerline Calculations

In yet another form of the present invention, the visualization andmeasurement system may incorporate means for determiningpatient-specific anatomical dimensions using appropriate scanned 2-Dimage data.

For purposes of illustration but not limitation, this aspect of thepresent invention will be discussed in the context of measuring apatient's vascular structure in the region of the aortic/iliacbranching. By way of further example, such measurement might beconducted in the course of repairing an aortic aneurysm throughinstallation of a vascular prosthesis.

More particularly, using the aforementioned scanning device 5, a set of2-D slice images is first generated, where each 2-D slice imagecorresponds to a specific viewing plane or “slice” taken through thepatient's body. As noted above, on these 2-D slice images, differenttypes of tissue are typically represented by different imageintensities. By way of example, FIG. 17 illustrates a 2-D slice image200 taken through the abdomen of a patient, at a location above theaortic/iliac branching; FIG. 18 illustrates a 2-D slice image 202 takenthrough the abdomen of the same patient, at a location below theaortic/iliac branching. In these images, vascular tissue might be shownat 205, bone at 207, other tissue at 210, etc. An appropriate set ofthese 2-D slice images is assembled into a 3-D database so as to providea volumetric data set corresponding to the anatomical structure of thepatient. Referring back to the system illustrated in FIG. 6, the set of2-D slice images making up this 3-D database might be stored in secondsection 40 of data storage device or medium 30. In this respect it isalso to be appreciated that the 3-D database being referred to now isnot the same as the 3-D computer model contained in first section 35 ofdata storage device or medium 30; rather, the 3-D database beingreferred to now is simply a volumetric data set made up of the series of2-D slice images contained in second section 40 of data storage deviceor medium 30.

Next, using the appropriately programmed computer 50, thepatient-specific volumetric data set (formed out of the collection of2-D slice images contained in the 3-D database) is segmented so as tohighlight the anatomical structure of interest.

This is preferably effected as follows. On the computer's display 60,the user is presented with 2-D slice images from the 3-D database, whichimages are preferably stored in second section 40 of data storage deviceor medium 30. As noted above, each of these 2-D images corresponds to aspecific viewing plane or “slice” taken through the patient's body; or,stated slightly differently, each of these 2-D images essentiallyrepresents a plane cutting through the patient-specific volumetric dataset contained in the 3-D database. As also discussed above, with each ofthese 2-D slice images, the different types of tissue will generally berepresented by different image intensities. Using one or more of theinput devices 55, e.g., a mouse, the user (who might or might not be aphysician) selects a particular 2-D slice image for viewing on display60, e.g., “slice image #155”. The user then uses one or more of theinput devices 55 to select one or more points located within theanatomical structure of interest. For convenience, such user-selectedpoints can be referred to as “seeds”. See, for example, FIG. 17, where aseed point 215 has been selected within the interior of vascular tissue205 so as to identify blood. The user also uses one or more of the inputdevices 55 to specify a range of image intensities that appear tocorrespond to the anatomical structure of interest in the volumetricdata set, e.g., blood within the interior of a blood vessel.

In accordance with the present invention, the appropriately programmedcomputer 50 then applies a segmentation algorithm of the sort well knownin the art to segment out related structure within the patient-specific3-D database. Preferably computer 50 is programmed to apply a 3-Dconnected component search through the volumetric data set contained insecond section 40 of data storage device or medium 30 so as to determinethe set of volumetric samples that are (i) within the range specifiedfor blood, and which (ii) can be connected along a connected path backto one of the seeds, where each of the locations along the path is alsowithin the range specified for blood. The result of this 3-D connectedcomponent search is a set of 3-D locations in the volumetric data setwhich correspond to blood flowing through the blood vessel. For thepurposes of the present illustration, this set of 3-D locations can becharacterized as the “blood region”. The segmented anatomical structure(i.e., the blood in the blood region) can then be highlighted orotherwise identified on each of the 2-D slice images. See, for example,FIGS. 17A and 18A, where the segmented blood region in vascular tissue205 has been cross-hatched to represent such highlighting.

Next, the branches in the segmented anatomical structure are identified.For example, and looking now at FIG. 19, in the present illustrationdealing with vascular structure in the region of the aortic/iliacbranching, the aorta and the two iliac branches would be separatelyidentified.

This is done in the following manner. For each of the vessel segmentsthat are part of the branching structure of interest, the user specifiesa branch line in the volumetric data set that uniquely indicates thatvessel segment. This is accomplished by using one or more of the inputdevices 55 to select, for each branch line, an appropriate “start”location on one of the 2-D slice images contained within second section40 of data storage device or medium 30, and an appropriate “end”location on another one of the 2-D slice images contained within secondsection 40 of data storage device or medium 30. It should be appreciatedthat these branch lines do not need to cover the entire length ofinterest of the vessel and, in practice, will tend to stop somewhatshort of the junction where various branches converge with one another.At the same time, however, for improved accuracy of modeling thebranching structure, the branch lines should extend close to thebifurcation point.

For each of the vessel branches, the start and end locations are used tosubdivide the blood region as follows: the region for that vessel branchis the set of locations within the blood region that are between thestart plane and the end plane, where the start plane for each vesselbranch is the 2-D image plane passing through the start location for thecorresponding branch line, and the end plane for each vessel branch isthe 2-D image plane passing through the end location for each vesselbranch.

Although the invention could be used for a more complex branchingstructure through obvious extensions, it is useful to consider a vesselbranch structure consisting of just three vessel segments comingtogether at a branch point, e.g., a vessel branch structure such as theaortic/iliac branching shown in FIG. 19. In this case, the user woulddesignate one vessel region as the root region (e.g., the aortic region220 defined by a branch line 225 having a start location 230 containedin a start plane 235, and an end location 240 contained in an end plane245) and the other vessel regions as branch region A (e.g., the iliacregion 250 defined by a branch line 255 having a start location 260contained in a start plane 265, and an end location 270 contained in anend plane 275), and branch region B (e.g., the iliac region 280 definedby a branch line 285 having a start location 290 contained in a startplane 295, and an end location 300 contained in an end plane 305),respectively.

For each of the vessel regions determined in the previous step, acentroid path is then calculated. This is accomplished in the followingmanner. First, at intervals along the vessel line corresponding to thevolumetric location of each of the original 2-D slice images containedin second section 40 of data storage device or medium 30, the centroidof the vessel region in that particular 2-D slice image is calculated.This is done by averaging the image coordinates of all locations in that2-D slice image that are within the vessel region so as to yield acentroid point. See, for example, FIG. 20, which schematicallyillustrates the manner of calculating the centroid 310 for arepresentative vessel region 312 in a representative 2-D slice image315.

The centroid path for each vessel region is then established by thecollective set of centroid points located along that vessel segment inthree-dimensional space. The tortuous path corresponding to the rootregion is called the root centroid path and the tortuous pathscorresponding to branch regions A and B are called branch centroid pathA and branch centroid path B, respectively. See, for example, FIG. 21,which shows a plurality of centroids 320, a root centroid path generallyindicated at 325, a branch centroid path A generally indicated at 330,and a branch centroid path B generally indicated at 335, all shown inthe context of a vessel branch structure such as the aortic/iliacbranching example discussed above. It is to be appreciated that nocentroids will be defined in the “unknown” region 336 bounded by the endplane 245 and the start plane 265, and the “unknown” region 337 boundedby the end plane 245 and the start plane 295.

The system is programmed so that it will then apply a curve-fittingalgorithm to the tortuous centroid paths determined above so as tosupply estimated data for any portions of the anatomical structure whichmay lie between the aforementioned branch lines, and for “smoothing out”any noise that may occur in the system.

This is preferably done through a spline fitting algorithm effected inthe following manner. First, two new paths are created, by concatenatingthe points in the root centroid path 325 with the points in each of thetwo branch centroid paths 330 and 335, so as to create a path root-A anda path root-B. These two new paths are then used as the input to aspline fitting routine which selects the coefficients for a piecewisepolynomial space curve that best approximates the points along the pathin a least-squares sense. The number of pieces of the approximation andthe order of polynomial may be varied by the user. The resulting curvesmay be called spline-root-A and spline-root-B. See, for example, FIG.22, which illustrates the spline-root-B, generally indicated at 340.

Through numerical integration, the distance along the two splines (i.e.,spline-root-A and spline-root-B) can then be calculated using standard,well-known techniques, and the result can be presented to the user.These calculations can be used for a variety of purposes, e.g., to helpdetermine the appropriate size of a vascular prosthesis to be used inrepairing an aneurysm at the aortic/iliac junction.

In addition, using well established mathematical techniques, at anypoint along the spline paths, a tangent vector and a perpendicular planecan be readily determined either by direct calculation or by definitionin those cases where direct calculation would be undefined. Bycalculating the distance from the spline path to the points in thevolumetric data set corresponding to the vessel branch region that arewithin an epsilon distance of the perpendicular plane, the shape of thevessel at that point can be determined, and the radius of a circle thatbest fits the cross-sectional area of the vessel at that point can alsobe readily calculated. Again, this result can be used to help determinethat desired graft shape.

FIG. 23 is a flow chart illustrating how patient-specific anatomicaldimensions can be determined from scanned 2-D data in accordance withthe present invention.

In addition to the foregoing, it is possible to use the centerlinederived above to generate additional views for the observer, and/or tomake further anatomical calculations and measurements.

Oblique Slices Derived From The Centerline

Among other things, it is possible to use the centerline derived aboveto construct a series of oblique slices through the volumetric data set(which volumetric data set is formed out of the assembled scanned 2-Dslice images contained in second section 40 of data storage device ormedium 30) such that the reconstructed oblique slices are disposedperpendicular to the centerline.

More particularly, oblique slices per se are generally well known in theart, to the extent that such oblique slices are arbitrary planarresamplings of the volumetric data set. However, the utility of thesearbitrary oblique slices is limited for many applications, since thereis no explicit, well-defined relationship between their position andanatomical structures of interest. By way of example, in the case ofblood vessels, oblique slices taken perpendicular to the length of theblood vessel are of particular importance to the physician. However,when generating oblique slices using traditional techniques (e.g., bypointing with an input device 55 while viewing the display 60), it isvery difficult for the physician to specify the oblique slice which istruly perpendicular to the blood vessel at a specified point. Thisproblem is avoided with the present invention, which utilizes thecenterline as derived above to generate the set of oblique slices lyingperpendicular to the blood vessel. This set of oblique slices derivedfrom the centerline is preferably stored in a fourth section 400 of datastorage device or medium 30 (FIGS. 5 and 6).

In general, one way to think about generating any oblique slice is toconsider a four-sided polygon that is placed in the space defined by thevolumetric data set. This polygon is then scan converted to resample theaxial images so as to generate the oblique slice desired. As usedherein, the term “scan converted” is intended to refer to the well-knowntechniques of subdividing a polygon into regularly spaced intervals on arectangular grid.

In the present invention a programmable computer is used to generate thespecific set of oblique slices that is defined by the centerline derivedabove. This is accomplished as follows. First, the centerline is dividedinto n increments. This can be done with points P₀, P₁, . . . , P_(n),as shown in FIG. 24. A line T_(i) is then derived for each of the pointsP_(i), where T_(i) is the tangent line at that point P_(i). Finally aseries of oblique slices are produced by constructing a series offour-sided polygons, each of which is centered at P_(i) and normal toT_(i). The locations of the corners of the polygon are selected suchthat the resulting image orientation is as close as possible to apre-selected image orientation (e.g., axial). These four-sided polygonsare then scan converted as described above so as to provide the set ofoblique slice images lying perpendicular to the centerline. As notedabove, this set of oblique slice images is stored in fourth section 400of data storage device or medium 30. At the same time, the cornerlocations of each four-sided polygon associated with each oblique sliceimage is also stored in fourth section 400 of data storage device ormedium 30, whereby the precise location of each oblique slice imagewithin the volumetric data set is established.

As a result of the foregoing, the oblique slice images stored in fourthsection 400 of data storage device or medium 30 is available to beaccessed by computer 50 in exactly the same manner as the 2-D axialslice images stored in second section 40 of data storage device ormedium 30.

Furthermore, once the aforementioned oblique slices have been derivedfrom the centerline, these oblique slices can then be used for a varietyof additional purposes.

Measuring Diameters Along The Centerline

As noted above, the oblique slice images derived from the centerline canbe accessed by computer 50 from fourth section 400 of data storagedevice or medium 30. The physician can then use input devices 55 toinstruct computer 50 to access the oblique slice at a particularlocation along the blood vessel and measure the diameter of the same. Inparticular, the physician can use input devices 55 to access theparticular oblique slice desired and then lay down twodiametrically-opposed marks so as to define the diameter of the bloodvessel; the computer is adapted in ways well known in the art to thencalculate the distance between the two marks. In this respect it shouldbe appreciated that since the aforementioned oblique slice images are,by definition, taken perpendicular to the blood vessel at each pointalong the blood vessel, the blood vessel diameters so measured will tendbe much more accurate than diameters calculated solely off axial sliceimages, and/or off coronal and/or sagittal and/or “standard”,non-centerline-derived oblique slice images.

Measuring Distances With A Cumulative Sum Table

It has also been found that it can be advantageous to store theincremental distances between the centerline points P₁, P₂, . . . ,P_(n) in a cumulative sum table in which the first entry, C₀, is 0; thesecond entry, C₁, is the distance between P₁ and P₀ (i.e., C₁=P₁−P₀);the third entry C₂=C₁+(P₂−P₁); etc. Thus, the centerline distancebetween any two points P_(i) and P_(j) is simply D_(ij)=C_(i)−C_(j).

In the present invention, the cumulative sum table can be of the sortshown in FIG. 25. This cumulative sum table is preferably stored in afifth section 405 of data storage device or medium 30. Computer 50 isalso programmed so that the user interface presents a centerline lengthcalculation dialogue box 407 (FIG. 26) to the physician on display 60,by which the physician can specify (using input devices 55) two obliqueslice images which are the end points of the length which is to bedetermined. Computer 50 is programmed so that it will then determine thelength between the two chosen oblique slices by calculating thedifference in their positions from the cumulative sum table.

Computer 50 is also programmed so that a 3-D graphical icon 408 (FIG.27) is inserted into the 3-D model contained in first section 35 of datastorage device or medium. 30. This icon represents the portion of thevessel centerline which has been specified by the physician via the twooblique slice images which represent the length end points.

Calculating Volumes Using A Cumulative Sum Table

A cumulative sum table can also be used to calculate volumes withrespect to an anatomical structure, in much the same way that acumulative sum table can be used to calculate lengths along ananatomical structure. However, incremental slice volumes are moreappropriately calculated in the axial direction rather than in theoblique slice direction. This is because the axial slices all lieparallel to one another, whereas the oblique slices (since they aregenerated from the centerline) do not.

To this end, a computer is used to calculate the volume of each axialslice, V_(i), by (1) determining the number of pixels in the segmentedregion of that axial slice, (2) scaling by the appropriatepixel-to-length factor, and then (3) multiplying by the slice thickness.A cumulative sum table is then generated, where the first entry, C₀, isV₀; the second entry, C₁=C₀+V₁; the third entry C₂=C₁+V₂; etc. In thepresent invention, this cumulative sum table can be of the sort shown inFIG. 28. This cumulative sum table is stored in sixth section 410 ofdata storage device or medium 30. Computer 50 is also programmed so thatthe user interface presents a volume calculation dialogue box 412 (FIG.29) to the physician on display 60 that allows the physician toconveniently specify two axial slices as the end points of the volume tobe determined. Computer 50 then calculates the volume for the regionspecified, using the cumulative sum table. Computer 50 is alsoprogrammed so as to place a 3-D graphical icon 415 (FIG. 30) in the 3-Dmodel contained in the first section 35 of data storage device or medium30. This icon represents the volume specified by the physician using thevolume calculation dialogue box.

Further Modifications

It is also to be understood that the present invention is by no meanslimited to the particular construction herein disclosed and/or shown inthe drawings, but also comprises any modifications or equivalents withinthe scope of the claims.

1. A system for determining a dimension of an anatomical structure usingan appropriate set of 2-D slice images obtained by scanning saidanatomical structure, said system comprising: means for assembling saidset of scanned 2-D slice images into a 3-D database; means forextracting an anatomical feature from the information contained in said3-D database; means for specifying a measurement to be made based onsaid extracted anatomical feature; and means for calculating themeasurement so specified.
 2. A system according to claim 1 furthercomprising means for generating a set of oblique slice images from said3-D database, wherein the orientation of said oblique slice images isdetermined by the configuration of said anatomical feature.
 3. A systemaccording to claim 2 wherein said system comprises means for specifyinga measurement to be made based on one of said oblique slice images.
 4. Asystem according to claim 1 wherein said anatomical feature is thecenterline of said anatomical structure.
 5. A system according to claim4 wherein said system comprises a cumulative sum table derived from saidcenterline, and further wherein said means for calculating utilize saidcumulative sum table to determine a length measurement.
 6. A systemaccording to claim 1 wherein said system comprises a cumulative sumtable derived from said anatomical feature, and further wherein saidmeans for calculating utilize said cumulative sum table to determine avolume measurement.
 7. A system for visualizing an anatomical structureusing an appropriate set of 2-D slice images obtained by scanning saidanatomical structure, said system comprising: means for assembling saidset of scanned 2-D slice images into a 3-D database; means forextracting an anatomical feature from the information contained in said3-D database; means for specifying a view to be rendered based on saidextracted anatomical feature; and means for rendering the view sospecified.
 8. A system according to claim 7 further comprising means forgenerating a set of oblique slice images from said 3-D database, whereinthe orientation of said oblique slice images is determined by theconfiguration of said anatomical feature.
 9. A system according to claim7 wherein said anatomical feature is the centerline of said anatomicalstructure.
 10. A method for determining a dimension of an anatomicalstructure using an appropriate set of 2-D slice images obtained byscanning said anatomical structure, said method comprising the steps of:(1) assembling said set of scanned 2-D slice images into a 3-D database;(2) extracting an anatomical feature from the information contained insaid 3-D database; (3) specifying a measurement to be made based on saidextracted anatomical feature; and (4) calculating the measurement sospecified.
 11. A method according to claim 10 wherein Step 2 includesthe step of generating a set of oblique slice images from said 3-Ddatabase, wherein the orientation of said oblique slice images isdetermined by the configuration of said anatomical feature.
 12. A methodaccording to claim 10 wherein said measurement is specified with respectto at least one of said oblique slice images.
 13. A method according toclaim 10 wherein said anatomical feature is the centerline of saidanatomical structure.
 14. A method according to claim 13 wherein Step 2includes the step of generating a cumulative sum table derived from saidcenterline, and further wherein Steps 3 and 4 are conducted with respectto said cumulative sum table to determine a length measurement.
 15. Amethod for visualizing an anatomical structure using an appropriate setof 2-D slice images obtained by scanning said anatomical structure, saidmethod comprising the steps of: (1) assembling said set of scanned 2-Dslice images into a 3-D database; (2) extracting an anatomical featurefrom the information contained in said 3-D database; (3) specifying aview to be rendered based on said extracted anatomical feature; and (4)rendering the view so specified.
 16. A method according to claim 15including generating a set of oblique slice images from said 3-Ddatabase, wherein the orientation of said oblique slice images isdetermined by the configuration of said anatomical feature.
 17. A methodaccording to claim 15 wherein said anatomical feature is the centerlineof said anatomical structure.
 18. Storage media comprising: a firstsection comprising 2-D axial slice image data; a second sectioncomprising 2-D coronal slice image data; a third section comprising 2-Dsagittal slice image data; and a fourth section comprising means usableby a computer for accessing said image data contained in said first,second and third sections.
 19. Storage media according to claim 18wherein said media further comprises a fifth section comprising a 3-Dcomputer model of a patient's anatomical structure.
 20. Storage mediaaccording to claim 19 wherein said media further comprises a table ofresults from volume calculations.
 21. Storage media according to claim20 wherein said media further comprises 2-D oblique slice image data.22. Storage media according to claim 21 wherein said 2-D oblique sliceimage data is derived from the centerline of said anatomical structure.23. Storage media according to claim 22 wherein said media furthercomprises a table of results from length calculations.
 24. Storage mediaaccording to claim 23 wherein said storage media comprises a CD ROM. 25.An article of manufacture comprising: a computer usable medium havingcomputer readable data means embodied therein, said computer readabledata means embodying: a first database comprising 2-D axial slice imagedata; a second database comprising 2-D coronal slice image data; and athird database comprising 2-D sagittal slice image data.
 26. A computerdata structure comprising: a first database comprising 2-D axial sliceimage data; a second database comprising 2-D coronal slice image data; athird database comprising 2-D sagittal slice image data; and meansusable by a computer for accessing said image data contained in saidfirst, second and third databases.